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Abstract 

A remote camera relay and docking apparatus comprising a portable enclosure for 
attaching a hand-held digital camera thereto and comprising commmncations means for 
transparently relaying control signab and imagp data between the digital camera and a distant 
processor. Data rate conversion and error correction coding are included for providing reliable, 
low power communications without the need for flow control or handshaking. The processor 
operates the digital camem remotely over a commmucations channel such as a diakip telephone 
network, an infra-red link or a wireless RF link. In one configuration, the communications 
means comprises a modem for exchanging control and image data between the camera and 
distant processor, mdigitalcameraattaches to the relay apparatus by means ofastandard 
cameramounting screw. In another configuration, the digital camera attaches witM^ 
resistant case which contains the relay commimicatiom! electronics, electrical signal interfaces 
for connectingthe digital Camera thereto and a power source. Power management is also 
provided for maximizing operating time when used In low power, portable, battery operation. 



Background 

This disclosure relates to remote digital camera operation which receives camera 
commands and transfers digital photographs to distant locations by combining the arts of digital 
camera technology and communications methods. In many applications there is a need to 
control camera functions and to view the resulting photographs from distant locations such as in 
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viewing construction site progress, surveillance of unoccupied residences, vacation proper^, 
boats and any other application where visual observation fiom a distant location is desired. 

Commercial digital camera products, which store images in m«noiy as data rather than 
as optical images on film, arc becoming widely available. In these devices, image data is 
captured mto RAM, flash memory or floppy disk whocby the electronic unage data becomes 
immediately accessible after a picture is taken. Although many digital camera products provide 
an LCD display for instant image monitoring, in general the data must be transferred firam Ae 
camera to a computer, printer or other type of controller in ordw to view the images. As such, 
digital camera products typically include a communications intcrfece in order for the data to be 
transferred or uploaded to a receiving device. An application program run on a computer 
controls several camera functions inchiding the transfer of image data from Ae camera to the 
computer, image editing and image storage. ScHne ^plication programs allow for control of the 
camera shutter function and also for the deletion of images stored in the camera. 

Typically, the computer and camera are collocated in practical use. Control of a digital 
camera by application software is generally done by a direct connection between the computer 
serial port and the camera communications port Such a connection is highly reliable since fte 
camera and computer arc in close proximity, use a physical wire connection between Ae devices 
and involve a simple data exchange between a single source and a single destination, 

The use of modems for transmitting digital data over a phone line is well known. 
Modems commonly interface to a computer by means of a serial interfiwje known as an RS-232 
or more recently Universal Serial Bus (USB), whidi defines a standard communications protocol 
including data formats, data rates and voltage levels v*ich encapsulate flie raw data. The 
modem converts the serial data into a signal compatible with the particular phone service being 
used, then transmits the signal over the medium. In addition to conventional analog phwie 
services, direct digital and wireless telephony are rapidly becoming available in an assortment of 
communications products. 
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Several types of imagp teIq)hony devices exist TTiese include video phones, video 
teleconferencing products and digital cameras direcdy connected to a computer for subsequent 
modem or LAN transmission. Remote video image devices connected directly to a computer has 
many disadvantages for field use. First, a collocated computer is a relatively expensive 
installation, especially if it is used only for a remote imaging function. Second, a remote, 
collocated compute requires significant power which does not lend itself to continuous field use 
under battery operation for extended time periods. TTiird, a remote field computer must be made 
to withstand various weather conditions which would significantly add to cost Fourth, the 
aggregate combination of a computer, modem and camera requires separate, bulky components 
which doesn't lend itself to a portable eiBcient integration. 

SUMMARY 

The remote camera relay controller method and apparatus provides an inter&ce and relay 
between a remotely located imaging input device such as a digital camera and a local computer 
or controller. The q)paratus allows for a connection between camera and computer, but instead 
of a conventional serial port interface between the computer and digital camera, the relay 
apparatus remotely forwards data through a communications link. Camera and computer 
interface signals are regenerated after passing throu^ the link, thereby establishing a virtual 
inter&ce between end-points. 

The addition of conmiunications forwarding devices between the remote camera 
and host processor introduces several problems. These include data rate incompatibilities, data 
overflow and the introduction of bit errors, which don't exist in a collocated camera-computer 
configuration. In order to provide reliable, seamless communications, the relay controller 
performs data rale compensation by means of rate conversicm, provides data formatting, 
establishes link communications, provides error control, forwards image data, sends and receives 
control data. 
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For general purpose operation, the camera relay operates independently of specific 
camera data protocols. It does this by transparently streaming data between flie camera and host 
computer without dq)ending on handshaking or flow control with tihe relay controller apparatus. 
In order for this to be achieved, two critical constraints must be satisfied. First, clock timing 
inaccuracies that normally occur between Ae different communications nodes must be 
compensated for Second, data flow through the relay must be sufficiaitly error-free in order not 
to interfae with the normal data exchange expected between end point devices. 

A communication method is herein disclosed \*ich takes advantage of the inhwent 
asymmetrical characteristic of information flow in the use of digital imaging in general. In 
contrast to a typical bi-directional communications channel wherein the data rates and 
information size are more or less equal, a digital camera involves small amounts of data traffic in 
one direction but large amounts in the other. The command and control signals into Ae camera 
which trigger camera functions such as shutter release, delete photo or get-image only tab: a few 
bytes. Transferring the image data in the opposite dntction, from the camera to the host 
computer however, takes from tens to hundreds of thousands of bytes depending on image 
resolution and image compression algorithms employed. 

The remote camera relay controller apparatus addresses the problem of data rate 
incompatibilities caused by close but unequal end-to-end baud rates during on-line operation by 
taking advantage of the digital camera data asymmetry. It does this by using rate conversion 
means to step up the data rates at each node when image data is transferred from the camera back 
to the host. This method effectively eliminates overflow conditions and the need for flow 
control or handshaking. Each of the receive node in the communications chain passes the 
camera image data on to the next node at a higher rate than received. Stepping up the rate in one 
direction would necessarily cause a down stepping in the opposite which would normally impact 
reliable communications in this direction. Due to the extremely low command and control 
traffic from host to camera, data flow in this direction becomes insensitive to rate down stepping. 
This concept will be further developed in the following sections. 
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The remote camera relay controller also performs ancillary control functions such as 
receiviDg command sCTipts from tte host, ranotely downloading a schedule of camera events 
and autonomously issuing camera commands at programmed times, b addition, the relay 
apparatus has the ability to autonomously initiate and establish communications and to relay 
camera image data back to the host 

Objects and Advantages 

An object of the disclosed invoition is to provide for a small, portable and robust 
integration of camera and communications componwits to effectively function as a single remote 
imaging and communications unit, but also to allow for the separate and independent opemtion 
of the digital camera when the relay controller is not attached. 

Another object of this invention is to allow the use of tiie disclosed relay controller as an 
add-on option to commercially available digital cameras thereby offering a remote, unattended 
imaging capability to digital cameras. This would greatly lower tiie cost of a remote imaging 
capability since tiie camera would have a dual use as a conventional camera. 

Another object is to provide a metiiod for a general purpose remote image relay device 
which transparently interconnects a commercial digital camera to a local host viewer without tiie 
need for communications flow control or handshaking. 

Anotiier object is to apply low power communications mefliods and error correction 
coding for transmitting remote camera images to a receiver. 

Anotiier object of tiiis invention is to provide a weattier-resistant enclosure comprising 
wireless communications means in which a commercial digital camera can be mserted and 
protected from the elements. 

A further object is to provide a low cost, modular, remote image relay means by using 
flie image acquisition and storage capabilities of a commercial digital camera witfiin flie 
communications relay enclosure. 

Still fiuther, tiiis disclosure presents a metiiod and apparatus for passing image data from 
a remote digital camera to a local controller witiiout tiie need of a collocated computer at tiie 
remote location. 
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Yet another object of the disclosed apparatus is toallow for the re^^^ 
schedules and camera control scriptsoverthe communications link and to 0^^ 

1^ automatically taking photos in accordance with said control script 

It is also an object ofthe disclosed apparatus to provide efficient power management 

using rate conversion and signd processing methods so that the digital earner 
extended time periods in a portable, battery operated configuration. 



TtetcriDtion nf Drawinp 

Fig lA shows amodem configuration of the remote relay controUer in relation to an 

external digital camoa attachment 

Fig IB shows a wireless communications configuration of the remote relay 

controller in relation to a digital camera attachment 

Fig 2Ashowsamodcm configuration of the remote relay controUer which encloses 

a digital camera. 

Fig 2B shows a wireless communications configuration of the remote relay 

controller which encloses a digital camera. 

Fig3Aisahigh-tevel block diagram of an embodiment of the remote camera rehiy 

and its relationship to communications with a host computer. 

Fig 3B shows a high-level block diagram of the remote relay controller using data 

rate convater and modem. 

Fig 3C shows a detaUed block diagram of the data rate converter using Error 

Correction Coding. 

Fig4 is ablockdiagramoflheimoterebycontioller inawirelessforwaiding 

system configuration. 

Figs 5A to 5E show detailed block diagrams of various opemtional modes of the 

digital relay controller electronics. 
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Principle of Operation 

A digital camera is used to take photograplis. but unlike ordinary film, the images are 
stored elecliomcally as digital data. In cider to view the images, the digital data is Benerally 
uploaded to a computer by means of a serial interfice. Communications with the comiected 
camera is generally established by an asynchronous serial data format where bytes are 
transmitted along with overhead bits at known standard data rates. Asynchronous 
communications can also provide flow control and error checking. 

Vendor proprietary protocols are often used when exchanging commands, 
acknowledgments and data between the camera and the computer appUcation software. Be 
Q specific formats of the command strings and image data vary from product to product, however 

! J the fcndamental camera operations are comastent These included shutter control, image 

ii deletion and uploading of images. Power on/offcontrol and record/pby control are sometimes 
I not accessible from the serial interface. In this case manual operations mustbcperfonnedby 

depressing physical switches on thecamera Hie record/play switch allows the camera to take 
[li pictures in die record mode and to view photos in the pby mode. Manual switching helps to 
i]i prevent umdvcitcnt recording and powering but as a result, requires meamj other than the 

S communications interface to operate these functions. 

^ Many digital cameras are available which can be completely controlled via serial 

port commands, without the need for manual switch access. An example is the Largaa. Inc. 
Model 350 digital camera which is used as part of the preferred embodiment disclosure. In order 
to allow for remote control in other digital cameras requiring manual switching, direct access to 
theswitchcontactpointsbytherelaycontroUermaybeused. Aswitch can be made to 'close- 
by providing an appropriate voltage to the contact points whichmimicsthesame voltage as that 
of the manually closed switch. This results in an identicalcamem response as the manually 

switched circuit 

One ofthefimctions of die disclosed invention is to reproduce the camera command 
sequence that would normally appear at the communications interfiice as if a direct comiection to 
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a computer were present Data interfece is accomplished by means of a physical connector 
between the serial port of the digital camera and the relay contioller electronics. Some recent 
digital cameras however, employ an mfrfrred (IR) link for communicating between the camera 
and the controlling computer. Without loss of generality, an IR link can be applied to the relay 
controller as well As an aftemative, or in addition to a serial signal cable or IR link between 
camera and relay controUer, the enclosure can include external signal contact points located at 
positions that mirror associated contactpoints on the camera body. AfBxing the camera to the 
relay enclosure mates the contact points and thus establishes electrical communications. 

nie relay controller inctades a capability for difEaentiating between various types of 
received data packets. Command packets that are intended for direct control of the camera can 
be routed directiy to the camera interfece. Received command and control scripts intended for 
the relay controller can be recognized and routed thereto. For example, the relay controller can 
be commanded to store the received command scripts and repUy the command scripts at 
programmed times thereby allowing for autonomous photography operation whhout direct on- 
line control. Application software nmning on the distant processor can be programmed to 
transmit these different packet types depending on desired functionality. 

The disclosed invention provides several communications modes. The first 
transparentiy passes a reproduction of the serial signal data that is present atlhe 
camera/computer interfece through a modem awl USART combimtfion. For example, a 
command byte string sent fiom the computer serial mterfece. through the transmit modem will 
reappear intact at the camera interface after passing through the receive modem and receive 
USART. 

A second mode re-cieates the voltage levels at the switch contact points, as 
described previously. In this mode, unique received command sequences are transformed by the 
relay controller and then turned into signals that are used to activate the manmd camera functions 
including power on/off and switching between the record and play modes if necessary. 
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In a diiid mode, uiriquc commands are recogm28d by the controller relay, but 
ignored by the camera. Onceacommand is recognized, it triggers the generatim 
cameracontrolsequence. Tliereby, the transmbsionofthe actual sequence in a real-time 
coDocatedcomputercicchangebecomesunnecessaiy. TOs mode alkws for the relay controUer 
to issue camera command sequences autonomously for direct control ofthe computer and 

communications link. This is usefol in taking pictures in accordance with a schedule of 

programmed events. 

The operation ofthe enclosure adds to the oveiaU fimctiomdily of this invention, 
•me enclosure has a form-factor v.hich houses the modem. USART, and processing electronics, 
but dso comprises means for attachment of the camera usingastandaid threaded camera screw 

mount typically found on photographic equipmem. Access to the manual switch co^^ 
is made available to the relay electronics by positioning the contact points on the camera b^^ 

locations corresponding to those on the relay enclosure. Pressure on the mating contacts, exerted 
bytighteningthemountingscrew.results in the electrical connection therebetween. 

A serial communications comiector, a modem comiector and a power connector are 
included as ports on the enclosure body. When mounted to a camera, the relay controller 
invention results inaclean, integrated unit having all cables and comiectors neatly ai™ 
Package size is minimized by use ofamodular modem, such as the Cermetekmodel#l798, and 

integrated ASIC electronics for providing all electronics processmg in a small package, 
compatible with the size, shape and footprint ofthe attached camera. 



Rate Converter 



A key aspect ofthe remote relay controller is to transparently pass command and image 
data between the remote camera and the local processor through the modem using minimal 
hardware processing in the field. In a conventional configuration where the digital camera is 
directly comiected to the computer serial poit,amodcm is not invoWed. In this direct interface. 

a constant baud rate is selected and signal handshakmg is sometimes used to insure reliable 
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communications. Even without handshaking or flow control, a collocated camera and computer 
can depoid on static baud rates and relative^ eiror-fiee data transfw without e)q)eriencing data 
overflow or underflow. For example if the computer serial port and the digital camera are both 
set to operate at 19,200 baud, then data throughput can always be maintained since there is only 
one sending device and onie receiving device; the computer and camera, for example. 

With the introduction of a modem within the signal path however, a constant baud rate 
between each device wiU result in data loss and render the communications unworkable. This is 
because of a slight offiet betvireen asynchronous clocks in die communications chain. For 
example, if the digital camera transmits data at 19,200 baud to a send modem, the receive 
modem may actually be communicating with Ae local computer at a sligjitly lower rate due to 
Q clock inaccuracies; 19,100 baud for example. In this example, two data forwarding devices are 
![J involved; the camera communications port, whidi transfers data to tiie send modem and the 
!aJ receive modem, which in turn transfers data to the computer serial port As commands and 
i| image data are streamed between the camera and computer end points, data will be lost due to 
overflow of image data at the send modem if DCE rates are too low, or at the computer due to 
j!± USART rate inaccuracies. In contrast, a collocated computer/camera combination has a single 

data originating device and a single receiver which does not incur an overflow condition. 
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2 The remote relay controller solves Ais problem by providing rate conversion means for 

stepping up the image data transport rate at each stage. TTiis is done by operating the camera at 
one rate, setting the modem communications (DCE) rate at a second higher rate and operating 
the local host processor at a third rate higher than the previous two rates. For example, the rate 
converter can accept remote camera data at 19,200 baud, accumulate a packet of bits, then 
transmit the packet to through the modem at 24,000 baud then on to the local host processor at 
38,400 baud. A data packet can be a standard USART byte format conainmg a start bit, eight 
data bits and a stop bit Simse the data transported at each stage is higher than the previous, there 
is no chance of overflow at the receiver and a continuous 19,200 baud camera transmission 
throughput can be maintained indefinitely. The modem DCE communications rate must be set at 
a rate high enough to accommodate camera data throughput plus the addition of modem protocol 
overhead data and flie occasiomd retransmission of erroneous modem data packets. Although 
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modems negotiate DCE rates dependmg on telephone channel conditions, in the preferred 

embodimentthe digital camera is settoadefiudtrateofW^OO. the modem 

operate whhaminimum data rate of21.600 and the local host processor is set toarate of 

3S,400. 

Since the data in the reverse direction must pass through the same electronics as in 
theforvraid direction, thedalarateateachstagebecomessteppeddo^^ Data arriving from the 
local host computer atacontinuous38,400 baud iate,tnmsmitted through the mo^ 

baud and relayed to the camera at 19.200 baud cannot in general maintain a continuous rate 
without data loss/However. command and control data packets comprise rektiw^^ 

packets and are not continuous. For example, in the Largan Digital camera the "take photo- 
command is only two bytes long. A small bufe in the tacal send modem and the remote receive 

modem can easily absorb the bytes transported at the 38.400 baud rate as long as the avera^ 

data embedded within does not exceed thecame« input baudiate and thenumber of conti^^ 

data bytes does not exceed the buffer capacity. 

Rate conversion in the remote camera relay controller includes the operations of 
stepping up the baud rate in the image transfer direction and stepph^ down the baud rate 

command and control direction without suffering any loss of information. 

ab ility to transparently perform data transfer through the remote relay wito^ 

control or handshaking. This allows for the use of off-lhe-shelf digital camera control software 

toremotelyopeiateadigitalcamerathroughtheiemoterelay.withoutmodificatfon. 



Bate ronversiop ft'r TtF Transmit Power Reduction 

In a wireless embodiment, the remote camera relay uses an RF link as the 
communications medium to transfer image data between the remote digital camera a^^ 
host computer. In this configuration a portable, battery operated openition is realized, 
several factors includmg battery energy consumption, maximizmg reception distance and 
minhnizing radiated power must be considered. 
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h most lonote viewing applications, ftero is expected to be a relatively long idle 
time between snapshots. TTje null time periods between photos can be taken advantage of by 
applying signal processing methods to reduce transmitter power, extend reception range, 
improve reliabiUty and extend battery life. In RF communications systems, it is well known that 
reliable data reception is dependent on the ratio between transmitter energyi)er-bit and electrical 
noise OBWNo). EWNo can be increased by stq)ping down the camera image data rate, thereby 
resulting m more aiergy per bit transmitted. 

In contrast to stepping up camera image data rates for the purpose of allowing real- 
time error-free contmuous throug^ipHt; a stepped down rale conversion in the RF link can be 
Q accomplished by accepting the camera image data at the nominal camera baud rate, buffering the 

!■* image data m the remote reUy controller, then passing the buffered image data at a much lower 

y rate to an RF transmitter. Alternatively, since digital cameras inherently store the captured 

|| mtages in internal memory, the camera could be commanded to output data at its lowest 

U commmiications port rate, thereby eliminating the need for additional buffer electronics in the 

remote relay controller. However, to achieve extrandy low rates and low power, an external 
!^ buffer is still required. It is well known to those skilled in the art of communications Aeory that 

transmitted power is the rate at which the bit energy in sent In other words, it takes more power 
S to transmit the same bit en»gy in a short time period as opposed to a long time period. If Ae 

^ image data captured in the digital camera is forwarded over a long time duration, then significant 

power can be saved. 

As an example, the ranote camera relay passes a command to flie (Ugjtal camera to 
upload a stored image through the serial communicatfons port. TTie relay receives nnagc data 
from the digital camera at a nominal 19,200 baud rate and temporarily stores the block of data in 
a buffer. The image data rate is tiien stepped down to 2,400 baud and passed on to an RF 
transmitter for sending the image data to an RF recewer. Attcmatively, the digital camera can be 
commanded to output image data at 2,400 baud, if possible, thereby eliminating the external 
buffer. TheLargandigitalcamereusedinthepreferredembodimenthowever, hasaminimum 
communications rate of 4,800 baud, therefore an additional rate converter must be used to obtain 
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2400 baud. At the lower rate, it takes eight times as long to transmit the buffered image data 
however, this requires only one-eighfli tiie radiated power for transmitting Ac same bit energy as 
the 19,200 baud rate. As an alternative to reducing radiated power, the signal can be transmitted 
at full power at 2400 baud resulting in a 9db energy gain which corresponds to several wders of 
magnitude improvement in bit error rate performance. 

The RF receiver which receives the image data thai converts the data to a standard 
USART signal which could be passed to the input of a local computer for viewing the image. 
The data can also be buffered, stepped up to a higher rate, 38,400 baud for example, and 
forwarded through a modem over a telephone line to a distant computer. The on-line connection 
time is minimized by forwarding the buffered image data, not the real-time 2,400 baud data, at 
the highest rate possible. 

Relay Communications Coding 

The expansion of the information bit ttansmission time of this invention allows for 
other communications techniques to be applied thereby offering even further advantages and 
benefits in addition to low power. For example, spread spectrum techniques such as direct 
sequence modulation could use the time-expanded bits for improved interference rejection. 
EnoT correction coding could be applied for decreasing the bit error rate or ahematively 
providing gain thus further lowering transmittw power. Spead spectrum and Error Correctira 
Coding are widely used in RF communications systems and are well known to those skilled in 
the art of electronic communications. In the preferred onbodimcnt example that follows, 
Forward Error Correction (FEC) coding is used in combination with time expansion of data for 
the purposes of reducing transmitted power, expanding relay controller battery life and 
increasing the reliability of the communications by decreasing bit-error rate. 

In error correction coding, redundant bits are appended to the original information 
bits in accordance with a given encoding algoritimi. In doing so, received bit errors can be 
detected and corrected by a compatible decoding algorithm before passing flie data on for 
subsequent processing. The fact that bit errors can be corrected at die receiver allows some 
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degradation to occur in the RF link without suffering a performance penalty. TWs impUes that a 
reduction in tiansmitter power or a reduction in Eh/No can be compensated for by taking 
advantage of coding gain. 

Many different types of error correction codes are available for this purpose, 
however in the prefened embodiment a Reed-Solomon code is used, due to its high performance 
and relatively simple encoding which is important for minimizing power and hardware in the 
remote, portable field unit Decoding is much more complex however, but decoding is done at 
the receiver side of the transmisston where low power and hardware sizing are not concerns. An 
example of a Reed Solomon code is the RS(255,191) code which can correct 32 bytes in error 
out of a bkxsk of 255 bytes. Tliis code requires 64 parity bytes to be appended to each 191 bytes 
□ ofinformationhowever.morethanSdbofcodinggainisachievedwhichisequivalenttothree- 

j- fold extension of transmitter battery life. Suramarizmg. error collection coding can be used to 

5 improve bit error rate performance and to significantly reduce transmitter energy consumption. 



0 



Description of Preferred Embodiment 



II 

m - 

I = Referring to Fig 1 A, an overall view of Ae remote relay controller in relation to an 

I external digital camera is shown. In this configuration, communications between the remote 

relay controller and a local processor is accomplished by means of a modem. Digital camera 2 
attaches to enclosure 1, which contains the relay controlfcr electronics and modem, by means of 
mounting screw assembly 3. A detail of mounting screw assembly 3 is shown as 38 which 
includes a threaded mounting screw4 on one end and a knuried knob 5 on the opposite end. 
Knurled knob 5 has embedded therein, a threaded cavity 6 for receivmg a reciprocal threaded 
screw for attachment of an additional mounting device suchas atripod, bracket or the Uke. 

Mounting screw 4 has a standard thread dimension such as that typically used to 
attach photographic equipment to a triH s«»nd. Momiting screw assembly 3 passes through 
enclosure 1 as shown. Attachmentof camera 2 to enclosure 1 is accomplished by tightening 
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screw 4 with knurled knob 5 into acavity within the body of camera 2 which has reciprocal 
direads for accepting screw 4. 

Shown in Fig lA is a connector cable 7, for electricalfy interfecing the control port 
of digital camera 2 to the relay electronics contained wifliin enclosure 1. In the modan 
configuration of Figure 1 A, an RJl 1 telecommunications receptacle 8, which is typically used 
for connection of telephone equipment to dial-up phone lines, is used to interfece tiie relay 
controller modem to communications signals. Bis is used for interconnecting the relay modem 
signals to a distant controller over a telephone network. 

Also shown on enclosure 1 is a multitude of electrical contact points 9. These are 
used as additional signal connections between digital camera and relay controller. Contact 
points 9 make a connection with corresponding contact points on the digital camera body when 
mounting screw 4 is inserted into tie threaded receptacle of the camera body and tightened by 
turning knurled knob 5. Contact points 9 are pushed against conresponding camera contact 
points, thereby establishing electrical communications between relay controller and camera. 

FIG IB shows a relay configuration which includes an RF link as an altwnative to a 
modem for establishing communications between the ranotc relay controller and a locd 
processor. Digital camera 2 attaches to enclosure 1 m an identical manner as that described in 
FIG 1 A. In the RF link configuration of HO IB, the camera control and image data signals are 
modulated onto anRFcarrierandpassedthrough antenna 7. In both configurations of HG lA 
and FIG IB a power connector 11 is shown for supplymg external power to the remote relay 
controller electronics. Internal batteries can alternatively be included withm enclosure 1 for 
operating die electronics. 

FIGS 2 A and 2B illustrate an alternative embodiment of the rehqr controlla- apparatus. 
In this configuration, digital camera2 is completely contained withm enclosure 12. Figures 2A 
and 2B correspond to a modem embodiment and RF embodiment, respectively. In HG 2A, 
communications signals between the remote relay controUer electronics and the local processor 
interfaced by means of RJl 1 telephone receptacle 17. In FIG 2B. RF signals are passed 



are 
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through antenna 18. Camera 2 attaches to slide rail 13 having a slot H with a threaded 
mounting screw IS. Slot 14, allows camera mounting screw 15 to be positioned at any point 
along slide tail 13. This makes it possible to accommodate various camera dimensions and 
mounting thread locations in order to properly position tiie camera so that its lens aligns with 
window 16 as slide rail 13 transports camera 2 laterally into tfie body of enclosure 12. This 
allows photographs to be taken while in the inserted position. Slide rail 13 is retained witiib 
enclosure 12 by using common attachment means including friction, mechanical fasteners or the 
like. 

Referring to FIG 3 A, a high-level block diagram of the remote camera relay and its 
relationship to communications with a host computer is diown. In this configuration a remote 
Q digital camera 23 receives commands originating from a local host computer 20 througji host 

communications transceiver 21 and remote communications transceiver 22. Camera 23, in turn, 
\il returns image data as well as command acknowledgments and other status information back to 

ly host computer 20 through transceivers 22 and 21. Host communications transceiver 21 receives 

data from host computer 20 then modulates the signal onto a suitable carrier for transmitting tiie 
! J. data across the transmission medium where it is received by remote communications transceiver 

I'U 22 before being passed on to digital camera 23. Transceivers 21 and 22 could be a pair of dial- 

up modems, wireless modems, RF link, infi^-red link or any other means for transporting data 
signals between dislocated end points. Similarly, in the opposite direction, transceiver 22 
receives data fiom digital camera 23 then modulates and transmits the data to transceiver 21 
which demodulates the signal and passes the data to host computer 20. An example of a camera 
command and image transfer will now be described. 

A camera command to "take a photo" is initiated by ^plication software running on 
local host computCT 20. The command has been formatted by the camera vendor software in 
accordance with the protocols required by the specific digital camera being used. A key point 
here is that it is not necessary for the remote relay controller to know the specific command 
fonnats and camera vendor protocols used, since the invention will transparently pass signals 
across the link tiiereby reconstructing the correct fomat at the camera port. It is a known 
characteristic, however Aat command packets for controlling camera fimctions are generally 
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very short in comparison to the very large data records returned from the camera. The camera 
software drivers which are supplied by the vendor, generally conform to industry standards sudi 
as Twain, which allows Ae use of Aird-party image application software. Although transparent 
communications allows for the use of vendor products without modification, the use of custom 
software for digital camera control is not precluded if camera data protocols are known. 

Referring to FIG 3B, a short byte sequence which is recognizable by the digital 
camera is passed out of host computer 20 through a standard serial port where it would normally 
expect the digital camera to be located. Instead, host modem 24 receives flie serial data from 
host computer 20. Remote modem 25, which has established communications with host modem 
24, passes the camera conmiand data to rate converter 26. The output of 26 is ftcn supplied to 
the serial communications port of digital camem 23. Since the command sequence received at 
the camera communications is identical to that which would have been received if camera 23 had 
been directly interfaced to host 20, camera 23 acts on the command and takes a photograph. 
Depending on the particular digital camera used, camera 23 will then either automatically pass 
the image data out of its communications port, or else it can be commanded to do so in a similar 
manner as that just described for taking the photo. In either case, a digital representation of the 
photo is passed from camera 23, appropriately formatted by the camera manufacturer, into rate 
converter 26. The output of 26 is then passed to modem 25 for transmission ofthe image data to 
host modem 24 which then supplies host computer 20 with the demodulated stream of data bytes 
which are recognizable by the host image viewing software. 

The function of rate converter 26 is to step up the data rate in the image transfer 
direction from remote camera 23 to local host 20. In this direction, large image data records are 
involved and it therefore becomes necessary to step up die rate in order to continuously and 
transparently forward the image data without flow control or handshaking. A typical color digital 
image having a resolution of 480 by 320 pixels contains from about 30,000 to 100,000 bytes 
depending on which image compression algorithm is used as part of the camera image format 

In the opposite direction however, commands from host computer 20 to remote 
camera 23 use the same hardware as m the forward direction and therefore are subject to a 
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stepped down baud rate as a result NonnaUy this would introduce an overflow problem. 
However, sinbe commands from the host involve only a few number of bytes, the small internal 
FIFO buffers typically inchided in modem electrcmics, can absorb the rate difference. Ahhou^ 
sHeppiag up flie rate in the image transfer direction is critical to transparent rely controller 
operation, the rate difference m die command and control direction becomes inconsequential. 

In the preferred embodiment, a Largan digital camoa is used wherein its default 
serial port rate operates at 19,200 baud. The unage data stream from camera 23 is then passed 
on to rate converter 26 which steps up the input serial rate from 1 9,200 to an output rate greater 
than 2 1 .600 baud, which is the DCE rate configured to be used between host modem 24 and 
remote modem 25. Depending on the particular modem used, a Umited degree of rate conversion 
can be performed withm the modem if configured in an unconventional manner. The Cermet* 
model #1798 modem can be configured to accept DTE data at one of several standard baud rales 
then transmit the data using a different DCE rate. The serial communications port of host 
computer 20 is configured to send and recewe data at a 38,400 rate. The net effect is an 
asymmetrical data transfer which transmits camera 23 data at 19,200 baud and is uWmately 
received by host computer 20 at 38,400 baud. In the reverse direction, commands origmale at 
host 20 at 38,400 baud which are uWmately received by digital camera 23 at 19^00 baud. 

Remote modem 25 is a cpmmwcial Cermetdc model #1798 modem vrfuch supports a 
range of modem standards and speeds. It has been selected because of its small size and high 
fimctionaUty. Communications modes can be programmed using tiie standard AT command set, 
well known to those skilled in the art of modem applications. The present invention uses several 
of die modem capabilities including automatic answer and linkconnectivi^. Modem 25 is 
configured with the following AT command settings which are st«»ed mternally to die Ceimetek 
modem in non-volatile RAM: 



ACTIVE PROFILE: 

Bl El LI Ml Nl QO T VI Wl X4 YO &C0 &D0 &G0 &J0 &K0 &Q5 &R1 &S0 &T5 &XO&YO 
800:001 801:000 802:043 803:013 804*10 805:008 806:002 807:050 808:002 809:006 
810:014 811:095 812:050 S18:0(K) 825:005 826:001 836KK)7 837K)00 838:020 844:020 
846:136 848:007 895:000 
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Tlis configuration allows for modem operation without flow control and without connection to 
data terminal equipment (DTE) such as a computer. In addition tiiese settings enable modem 25 
to automatically answer upon receiving a ring signal. The minimum modem modulation 
connection rate is set to 21,600 by using tiie following setting in which VJ4 modulation is 
selected: 

AT+MS=l 1,1,21 600,33600 

The exchange of modem signals for negotiations and establishment of a data connectivi^ are 
standard modem operations which are well known to those skilled in the art of modem 
communications. 

FIG 3C shows a more detailed functional block diagram of rate converter 26 used 
for stepping up the image transfer rate in a real-time image viewing application. Herein, image 
data from digital camera 23 of FIG 3B is received by USART 27 which converts tiie 19,200 
baud, serial format of tiie image data into byte-serial words. The output of USART 27 feeds 
buffer 28 which accumulates a block of data bytes before forwarding it on at a stepped up rate 
tiirougb error correction encoder 29 to USART 30. Although not required, encoder 29 in this 
case performs an error correction encoding algorithm for improving tiie image bit error rate as 
detected by a compatible decoding algorithm when received by the host computer. Error 
correction coding adds redundant bytes to ttie image data, tiierefore a code which adds only a 
small number of overiiead bytes must be used in order to maintain a stepped up rate. A Reed- 
Solomon (255,223) code satisfies this condition. In a minimum configuration, witiiout codmg 
however, only a single byte needs to be buffered since each byte arriving at USART 27 can be 
immediately transferred tiirough USART 30 at tiie higher rate. USART 30 will always be ready 
for data due to a fiasta: output rate flian byte arrival mte. Clock 31 feeds divider circuit 32 which 
supplies USART 27 witii a 19.200 baud rate and USART 30 witii a rate greater tiian 21,600 
baud. 
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Command packets in the opposite direction are received by USART 30 at the 
negotiated modem DCE rate exceeding 21,600 baud, then pass directly to buffer 28. Since 
command packets are short in duration, coding is not required for either power savings or error 
rate improvement, and is therefore not used. The output of buffer 28 is sent to USART 27 which 
is stepped down to 19,200 baud before passing on to the digital camm port 

FIG 4 shows a more detailed functional block diagram of the remote camera relay 
controller as used in a wireless configuration. Herein, an RF link is used to relay camera 
commands and image data between the remote digital camera and a forwarding dial-up modem, 
which in turn communicates with the host computer. In this case, the rate conversion function 
steps down the image transfer rate (instead of up as in the previous discussion) for a different 
purpose. In the RF link, baud rate limitations and overflow conditions due to interface timing 
differences, are not an issue, A stepped down image data rate can significantly reduce 
transmitted power and also unprove bit error performance. 

Image data from digital camera 23 is received by USART 27 which converts the 
19,200 baud, serial fonnat of the image data into byte-serial words. The output of USART 27 
feeds buffer 28 which accumulates an entire image block which could contain tens of thousands 
of bytes. The data block from buffer 28 is then input to Error Correction Encoder 29 which 
segments the data into sub-blocks and adds redundant bytes to each sub-block in accordance with 
the error correction algorithm being employed. In the preferred embodiment, a Reed-Solomon 
block code is used because it possesses several favorable attributes including high error 
correction performance, low overhead and relative simplicity of data encoding. The sub-block 
size depends on the specific coding format being used however for this embodiment, a Reed- 
Solomon(255,191) code, which is well knowTi to those skilled in the art of error correction 
coding, is applied. The encoded data block from 29 is passed on to USART 30 which converts 
the byte serial words back into a bit serial data stream at a stepped down rate of 2,400 baud. 
Clock 31 m this case feeds divider circuit 32 vdiich suppUes USART 27 with a 19,200 baud rate 
and USART 30 with a 2,400 baud rate. The ou^ut of USART 30 is then passed to remote RF 
transceiver 38 v^ch modulates the encoded and stepped down image data for trananission to 
forwarding KF transceiver 35. 
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Transceiver 35 demodulates the received image data and passes it to error 
correcdon decoder 36 which performs the Reed-Solomon(2SS,191) error detection and 
correctron algorithm. Decoder 36 corrects any errors that may have occurred in the RF link, 
strips ofiFthe parity bytes dien passes the decoded image data to image buffer 34. The data in 
image buffer 34 then passes on to forwardmg modem 33 at 19,200 baud rate. The rate 
conversion in this case is accomplished by controller 37 which is a PIC 17CXXX series 
microcontroller, which governs the data flow from buffer 34 into forwarding modem 33. 
Controller 37 also has an input to RF transceiver 35 for applying spreading and de-spreading 
pseudo-noise sequences if spread spectrum communications processing is employed. The data 
output from forwarding modem 33 is transmitted over a dial-up phone network to host modm 
Q 24, then passed on to host computer 20 for viewing images. 



< V 



Command data originating at host computer 20 passes in reverse through the 
identical processing chain* with the exception of the error decoding and error encoding functions, 
jl Command data from image buffer 34 passes directly to forwarding RF transceiver 35 and the 

f . remotely received command data is passed from USART 30 to buffer 28. As before, coding is 

lli not used in the command direction because of the short duration of conmiand packets. 

ry 

ifi FIG 5A is an implementation block diagram of the remote relay controller 

electronics, for performing the functions described in association with FIGS 3A-3C and FIG 4. 
A communications signal which has been properly formatted and transmitted with a send modem 
by a local processor, is received at the input of modem 41. The communications signal contains 
data within having a command protocol consistent with operation of the digital camera. The 
commands initiated by local processor are identical to those that would pass directly from an 
application software program to the camera communications port in a conventional collocated 
computer-camera configuration. A key function of die remote relay controller electronics is to 
transparently relay the conunands to the camera without necessarily having knowledge of its 
content 
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A&cr establishing modem communications, the modem outputs a standard RS232 
signal which is then passed to USART 42 where the RS232 start bit, stop bits and parity bits are 
removed, resulting in a byte serial format of the received data. The RS 232 signal is a well 
known communications protocol used frequently for data communications. The output of 
USART 42 is then passed to correlator-A 45, data latch-A 46, correlator-B 47, data latch-B 48 
and also to data selector-A which functions as a crossbar switch in combination with data 
selector-B 44. These wiU each be described. 

Commands initiated by the host computer comprise two types of data 
communications. The iirst are the packets sent by the camera application program and are 
intended to be received and operated on by the digital camera. The second are command and 
data packets intended for receipt by controller 49 included in this embodiment of the relay 
controller electronics. Unique header bytes are included in the data stream as part of the 
command packets sent by the host computer which indicate either controller commands or 
camera commands. The unique header bytes are recognized by correlator-A 45 which then 
enables data latch-A 46 to hold the subsequent command bytes received from USART 42. The 
output of data latch*A 46 then serves as the control signal for data selector-A 43 and data 
selector-B 44 which govern the selection of signal source and destination between USART 42, 
controller 49 and the interface signal from data selector-B 44 to the digital camera. 

Tie bytes that follow then indicate the presence of either camera control packets or 
relay control packets. If camera control packets are detected, then the signal path vAikh 
interconnects USART 42 communications directly to the camera serial port is selected (Path I). 
If command or data packets which are intended for controller 49 are detected, then a connection 
between USART 42 and controller 49 is established (Path U). A third signal path can be 
established which interconnects controller 49 and the interface between data selector-B 44 and 
the digital camera (Path III). This signal padi allows for the control of the camera directly by 
controller 49 rather than through the communications link emanating from the application 
program at the local computer. This supports autonomous operation of the camera by 
performing camera command scripts stored in the relay processor. An additional signal path 
which passes data between USART 43 and controller 49 simultaneously to a connection between 
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controller 49 and die output interface of data sdector-B 44 can be made (Path n and Path m). 
This path can be used to include data processing between the di^ camm and the forwarded 
data stream such as the baud rate conversion, Reed-Solomon error correction coding and image 
data buffering that was discussed in referoice to FIGS 3 A-3C and FIG 4. 

Also shown in FIG 5 A are connections between USART 42 to correlator-B and data 
latch-B 48. These function in a similar manner as that described for conrclator-A 45 and data 
latch-A 46, except in this case unique commands are recognized for directly controlling manual 
switch functions on fte digital camera rather than through the camera serial communications 
port. The manual switch command is passed from data latch-B 48 to signal converter 51 which 
translates the command into one of a multitude of output voltages. Each output from signal 
converter 51 corresponds to an individual manual switch on the digital camera, and has an output 
voltage which can be used to effectively activate the manual switch. Either a direct conna:tion 
y to the camera switch contact points can be made, thereby emulating the voltage that would 

'3 appear had the switch been manually depressed, or the outputs from signal converter 51 can be 

1« used to control an actuator for physically closmg the switch connection. 

vu Controller 49 can be a programmable device such as a microprocessor, RISC 

M processor. Field Programmable Gate Array (FPGA) or any other device known to those skilled in 

'fl the art of control logic implementation for receiving , storing and replaying command scripts 

^ sent from the host processor and performmg sequential operations in accordance with a 

programmed function. In the preferred embodiment a PIC 17CXXX series microcontroller is 
used due its small size, low power and adequate performance. Controller 49 is used to perform 
the rate conversion functions, Reed-Solomon coding, spread spectrum foraiatting and data 
buffering operations discussed previously. Other functions such as password verification, data 
encryption, image analysis, image processing, power management, autonomous phone dialing, 
event time logging and other ancillary functions can also be performed. Memory 50 is interfaced 
to and controlled by controller 49 for acquiring and storage of camera fanage data as well as other 
controller program functions which require memory. External event interface 52 is included to 
allow for external event triggers to activate camera functions in accordance with a corresponding 
program running on controller 49. For example, an intrasion signal derived from an external 
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